Powerful Exact Unconditional Tests for Agreement between Two Raters with Binary Endpoints
نویسندگان
چکیده
Asymptotic and exact conditional approaches have often been used for testing agreement between two raters with binary outcomes. The exact conditional approach is guaranteed to respect the test size as compared to the traditionally used asymptotic approach based on the standardized Cohen's kappa coefficient. An alternative to the conditional approach is an unconditional strategy which relaxes the restriction of fixed marginal totals as in the conditional approach. Three exact unconditional hypothesis testing procedures are considered in this article: an approach based on maximization, an approach based on the conditional p-value and maximization, and an approach based on estimation and maximization. We compared these testing procedures based on the commonly used Cohen's kappa with regards to test size and power. We recommend the following two exact approaches for use in practice due to power advantages: the approach based on conditional p-value and maximization and the approach based on estimation and maximization.
منابع مشابه
An efficient and exact approach for detecting trends with binary endpoints.
Lloyd (Aust. Nz. J. Stat., 50, 329-345, 2008) developed an exact testing approach to control for nuisance parameters, which was shown to be advantageous in testing for differences between two population proportions. We utilized this approach to obtain unconditional tests for trends in 2 × K contingency tables. We compare the unconditional procedure with other unconditional and conditional appro...
متن کاملExact unconditional tests for a 2 x 2 matched-pairs design.
The problem of comparing two proportions in a 2 x 2 matched-pairs design with binary responses is considered. We consider one-sided null and alternative hypotheses. The problem has two nuisance parameters. Using the monotonicity of the multinomial distribution, four exact unconditional tests based on p-values are proposed by reducing the dimension of the nuisance parameter space from two to one...
متن کاملTests for the homogeneity of two binomial proportions in extremely unbalanced 2 x 2 contingency tables.
Asymptotic tests such as the Pearson chi-square test are unreliable for testing the homogeneity of two binomial probabilities in extremely unbalanced cases. Two exact tests (conditional and unconditional) are available as alternatives and can be implemented easily in StatXact 6.0. In equal sample cases it is well known that the unconditional exact test is more powerful than the conditional exac...
متن کاملMore powerful exact noninferiority and equivalence tests based on binary matched pairs
Assessing the therapeutic noninferiority or equivalence of one medical treatment compared to another is often based on the difference of response rates from a matched binary pairs design. This paper develops new exact unconditional tests for noninferiority and equivalence that are more powerful than available alternatives. There are three new elements presented in this paper. First we introduce...
متن کاملA cautionary note on exact unconditional inference for a difference between two independent binomial proportions.
Fisher's exact test for comparing response proportions in a randomized experiment can be overly conservative when the group sizes are small or when the response proportions are close to zero or one. This is primarily because the null distribution of the test statistic becomes too discrete, a partial consequence of the inference being conditional on the total number of responders. Accordingly, e...
متن کامل